SMuSIM: a Prototype of Multichannel Spatialization System with Multimodal Interaction Interface

نویسندگان

  • Matteo Bozzolan
  • Giovanni Cospito
چکیده

The continuous evolutions in the human-computer interfaces field have allowed the development of control devices that let have a more and more intuitive, gestural and noninvasive interaction. Such devices find a natural employment also in the music applied informatics and in particular in the electronic music, always searching for new expressive means. This paper presents a prototype of a system for the realtime control of sound spatialization in a multichannel configuration with a multimodal interaction interface. The spatializer, called SMuSIM, employs interaction devices that range from the simple and well-established mouse and keyboard to a classical gaming used joystick (gamepad), finally exploiting more advanced and innovative typologies based on image analysis (as a webcam).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A VR Interface for Collaborative 3D Audio Performance

This paper presents a novel interaction paradigm to support musical performance using spatial audio. This method reduces the interface bottleneck between artistic intent and spatial sound rendering and allows dynamic positioning of sounds in space. The system supports collaborative performance, allowing multiple artists to simultaneously control the audio spatialization. The interface prototype...

متن کامل

MADFILM – a Multimodal Approach to Handle Search and Organization in a Movie Recommendation System

The MADFILM multimodal movie information and recommendation system prototype addresses the information search and recommendation problem with a natural language interface, and the information organization problem with a direct manipulation interface. The two modalities are integrated to allow for coordinated and simultaneous interaction. This paper describes the design and implementation of the...

متن کامل

Multimodal Human-Computer Interaction for Crisis Management Systems

* Corresponding author. Abstract This paper presents a multimodal crisis management system (XISM). It employs processing of natural gesture and speech commands elicited by a user to efficiently manage complex dynamic emergency scenarios on a large display. The developed prototype system demonstrates the means of incorporating unconstrained free-hand gestures and speech in a real-time interactiv...

متن کامل

Multimodal Data Flow Controller

In this paper, we describe a multimodal data flow controller capable of reading most multichannel sound cards and web cameras, synchronising media streams, being a server to stream captured media over TCP in raw format, being a client to receive media streams over TCP in raw format and using unified interface for online transmission.

متن کامل

Multimodal systems for children: building a prototype

In this paper, we describe our e orts in designing and building a prototype multimodal system for children users. Data collection e orts and user experience results from a WoZ study using a popular computer game are reviewed rst. Automatic speech recognition and spoken language understanding technology for children speakers are discussed next. A multimodal prototype is designed for a personal a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008